skip to main content


Search for: All records

Creators/Authors contains: "Moore, Kylie N."

Note: When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).
What is a DOI Number?

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

  1. We develop a framework to learn bio-inspired foraging policies using human data. We conduct an experiment where humans are virtually immersed in an open field foraging environment and are trained to collect the highest amount of rewards. A Markov Decision Process (MDP) framework is introduced to model the human decision dynamics. Then, Imitation Learning (IL) based on maximum likelihood estimation is used to train Neural Networks (NN) that map human decisions to observed states. The results show that passive imitation substantially underperforms humans. We further refine the human-inspired policies via Reinforcement Learning (RL) using the on-policy Proximal Policy Optimization (PPO) algorithm which shows better stability than other algorithms and can steadily improve the policies pre-trained with IL. We show that the combination of IL and RL match human performance and that the artificial agents trained with our approach can quickly adapt to reward distribution shift. We finally show that good performance and robustness to reward distribution shift strongly depend on combining allocentric information with an egocentric representation of the environment.

     
    more » « less
    Free, publicly-accessible full text available September 15, 2024
  2. Abstract

    While the brain’s functional network architecture is largely conserved between resting and task states, small but significant changes in functional connectivity support complex cognition. In this study, we used a modified Raven’s Progressive Matrices Task to examine symbolic and perceptual reasoning in human participants undergoing fMRI scanning. Previously, studies have focused predominantly on discrete symbolic versions of matrix reasoning, even though the first few trials of the Raven’s Advanced Progressive Matrices task consist of continuous perceptual stimuli. Our analysis examined the activation patterns and functional reconfiguration of brain networks associated with resting state and both symbolic and perceptual reasoning. We found that frontoparietal networks, including the cognitive control and dorsal attention networks, were significantly activated during abstract reasoning. We determined that these same task-active regions exhibited flexibly-reconfigured functional connectivity when transitioning from resting state to the abstract reasoning task. Conversely, we showed that a stable network core of regions in default and somatomotor networks was maintained across both resting and task states. We propose that these regionally-specific changes in the functional connectivity of frontoparietal networks puts the brain in a “task-ready” state, facilitating efficient task-based activation.

     
    more » « less